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User  interface 
technology  and  a 
therapy  model  create 
a  limited ,  “low- 
dose”  role  for  a  robot 
on  a  therapy  team 
for  children  with 
autism  spectrum 
disorder. 


Autism  spectrum  disorder  (ASD)  refers  to  a  group  of  pervasive  develop¬ 
mental  disorders  that  share  common  deficits  in  social  interaction  and 
communication.1  Such  deficits  may  be  manifested  as  the  inability  to  use  non¬ 
verbal  behaviors  (such  as  eye  contact  and  facial  expressions)  and  to  regulate 


social  interactions.  Furthermore,  about 
50  percent  of  children  identified  with  ASD 
present  with  insufficient  language  for  ef¬ 
fective  communication.2  Their  spoken  lan¬ 
guage  might  be  characterized  by  repetitive 
or  idiosyncratic  speech,  and  the  affective 
component  may  be  limited.3 

Social  interaction  doesn’t  motivate  or  en¬ 
gage  children  with  ASD  the  same  way  it 
does  their  typical  peers;  in  fact,  they  might 
show  more  preference  for  objects  over  peo¬ 
ple  than  do  their  peers  with  other  develop¬ 
mental  disabilities.4  For  this  reason,  speech 
and  language  intervention  designed  for  chil¬ 
dren  with  other  developmental  delays  might 
not  suit  the  needs  of  this  population.  Chil¬ 
dren  with  ASD  might  require  more  extraor¬ 
dinary  effort  to  elicit  social  interaction. 


Consequently,  therapies  designed  to  as¬ 
sist  children  with  ASD  necessarily  involve  a 
team  of  people.  At  the  Brigham  Young  Uni¬ 
versity  (BYU)  Comprehensive  Clinic,  this 
team  includes  a  primary  therapist,  a  second¬ 
ary  therapist,  a  therapy  supervisor,  and  the 
child’s  caregivers.  Even  with  this  extraor¬ 
dinary  effort,  interventions  that  reliably 
yield  improvements  in  social  interaction  and 
communication  are  still  needed,  especially 
for  very  low-functioning  children. 

Evidence  is  growing  that  robots  are  en¬ 
gaging  to  many  children  across  the  autism 
spectrum.5-7  Generalizable  child-human  in¬ 
teractions  are  the  sine  qua  non  of  assistive 
robotics  for  ASD  therapy,  however,  and  so¬ 
cial  engagement  with  a  robot  is  not  a  goal 
but  rather  a  means  for  helping  such  children 
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interact  socially  with  other  humans.  In¬ 
deed,  a  single-minded  focus  on  child- 
robot  interactions  could  potentially  ex¬ 
acerbate  problems  associated  with  ASD, 
such  as  echolalia  or  perseveration  on 
robotic  movements  or  sounds. 

Fortunately,  there  is  mounting  evi¬ 
dence  that  robots  can  help  trigger  so¬ 
cial  interactions  between  a  child  and 
another  person.5  Such  evidence  has 
yet  to  suggest  improved  interactions 
that  endure  or  that  generalize  outside 
of  a  lab  or  clinic,  however. 

In  this  article,  we  present  a  descrip¬ 
tion  of  the  teaming  environment  used 
to  provide  therapies  to  children  with 
ASD,  identify  the  role  a  robot  can 
perform  on  this  team,  and  describe 
robot  design  and  user  interface  tech¬ 
nologies  that  let  the  robot  perform 
this  role  within  a  broader  context  of 
the  team’s  shared  intentions.  A  case 
study  provides  compelling  prelimi¬ 
nary  evidence  that  this  team-based 
robot-assisted  approach  merits  care¬ 
ful,  ongoing  study. 

Embedding  Low-Dose 
Robotics  in  a  Team 

The  team-based  approach  to  ASD 
therapy  is  based  on  practices  in  the 
BYU  Comprehensive  Clinic,  which 
serves  children  and  adults  with  a 
wide  range  of  speech  and  social  defi¬ 
cits.  The  clinic  uses  professionally  su¬ 
pervised  graduate  student  therapists 
as  part  of  their  preparation  to  be¬ 
come  practicing  clinicians. 

For  children  with  ASD,  the  therapy 
team  consists  of  the  following  roles: 

•  the  primary  clinician,  who  is  re¬ 
sponsible  for  the  execution  of  a 
therapy  plan; 

•  a  secondary  clinician,  who  may 
provide  hand-over-hand  support 
for  a  child  with  ASD  during  the 
therapy  session; 

•  the  therapy  supervisor,  who  works 
with  the  primary  and  secondary 


clinicians  to  assess  the  child,  de¬ 
velop  a  therapy  plan,  and  evaluate 
therapy  sessions;  and 

•  caregivers,  who  work  with  the  ther¬ 
apy  supervisory  and  clinicians  to 
assess,  set  goals  for,  and  evaluate 
progress  of  the  child. 

These  team  members  follow  a 
roughly  sequential  process  (see 
Figure  1)  that  begins  with  an  initial 
assessment  and  a  careful  evaluation 
of  the  child,  and  then  iterates  through 
the  cycle  while  the  child  participates 
in  therapy. 

Children  with  ASD  come  to  the 
clinic  once  or  twice  each  week  for 
50-minute  sessions  tailored  to  help 
them  in  a  set  of  specific  areas.  Be¬ 
fore  each  session,  clinicians  develop 
several  activities  designed  to  pro¬ 
vide  structured  interaction  for  tar¬ 
geted  social  or  developmental  skills. 
During  therapy,  the  children  interact 
with  the  clinicians  and  often  a  par¬ 
ent,  with  five  to  10  potential  activities 
per  session. 

Here  we  focus  on  those  activities 
related  to  the  development  of  social 
communication.  Two  key  social  be¬ 
haviors  targeted  in  the  therapies  are 

•  responding  to  joint  attention  by, 
for  example,  following  an  eye  gaze, 
head  turn,  or  pointing  gesture;  and 

•  initiating  joint  attention  by,  for  ex¬ 
ample,  using  eye  gaze,  pointing, 
and  gestures  to  direct  the  attention 
of  a  social  partner  to  a  referent  of 
interest.8 

For  ethical  reasons,  we  decided 
before  beginning  the  work  that  we 
would  use  robot-based  activities  for 
no  more  than  20  percent  of  the  avail¬ 
able  therapy  time,  or  for  approxi¬ 
mately  10  minutes  of  a  50 -minute 
session.  Although  ethics  motivated 
the  limit  initially,  it  is  consistent  with 
the  therapeutic  goal  of  producing 


Figure  1.  Stages  of  the  therapy  team 
process.  The  team  works  through  an 
iterative  process  of  assessment,  goal¬ 
setting,  planning  interventions,  and 
implementing  interventions. 

generalizable  social  skills  in  the  child. 
Training  a  child  to  interact  with  a  ro¬ 
bot  is  less  likely  to  produce  child- 
human  social  skills  than  training  a  child 
to  interact  with  a  clinician  or  caregiver. 

We  refer  to  this  limit  as  a  “low- 
dose”  role,  targeting  two  specific 
functions:  engaging  the  child  and 
catalyzing  social  interactions.  Our 
results  suggest  that  such  a  low-dose  ro¬ 
botics  approach  can  not  only  simplify 
a  robot’s  design  and  behaviors  but  also 
produce  generalizable  child  behaviors. 
Simply  put,  by  designing  the  robot  to 
be  part  of  the  therapy  team,  we  can 
simplify  the  robot  design  problem  and 
make  the  therapies  more  effective. 

The  robot’s  role  in  therapy  can  be 
summarized  in  the  following  steps: 

1.  Engage  the  child’s  attention. 

2.  Trigger  dyadic  social  exchanges 
between  the  child  and  the  robot. 

3.  Support  triadic  social  exchanges 
between  the  child,  the  clinician  or 
caregiver,  and  the  robot. 

4.  Phase  out  in  favor  of  dyadic  social 
exchanges  between  the  child  and 
the  clinician  or  caregiver. 

Other  research  has  supported  the 
plausibility  of  fulfilling  these  steps  (see 
the  sidebar,  “Related  Work  on  Ro¬ 
bots  and  Autism  Therapy”).  For  ex¬ 
ample,  Kerstin  Dautenhahn  has  de¬ 
scribed  observations  from  the  from  the 
Autonomous  Mobile  Robot  as  a  Re¬ 
medial  tool  for  Autistic  Children 
(AuRoRA)  project,  which  studies 
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Related  Work  on  Robots  and  Autism  Therapy 


Several  researchers  have  demonstrated  the  potential 
for  engagement  between  a  child  with  autism  spectrum 
disorder  (ASD)  and  a  robot.  Hideki  Kozima  and  his  col¬ 
leagues  reported  that  children  who  interacted  with  the 
Infanoid  robot  became  engaged  enough  with  it  to  move 
through  phases  of  neophobia,  exploration,  and  interac¬ 
tion.1  Others  have  offered  evidence  that  children  with 
ASD  tend  to  engage  with  robots  differently  than  their 
typically  developing  peers  do.2'3 

Beyond  simple  engagement,  researchers  have  explored 
using  robots  to  improve  social  responsiveness  in  children 
with  ASD  and  to  help  create  relationships  with  humans.4-6 
Children  who  participated  in  a  study  using  Robota,  a  doll 
equipped  with  motors  and  imitative  capabilities,  exhibited 
signs  of  engagement  and  imitative  behavior  toward  the 
robot.7  Similarly,  studies  with  Kaspar  indicated  that  children 
displayed  social  interactions  with  the  robot.8 

Kozima  and  his  colleagues  also  conducted  a  longitudinal 
study  lasting  three  years  in  which  children  with  ASD  inter¬ 
acted  with  the  Keepon  robot  during  their  time  at  a  daycare 
center.1  These  children  were  reported  to  engage  spontane¬ 
ously  in  dyadic  interactions  with  the  robot. 

Several  studies  report  both  dyadic  child-robot  interac¬ 
tions  and  triadic  interactions  between  the  child,  the  robot, 
and  an  adult.9  Ben  Robins  and  his  colleagues  observed  chil¬ 
dren  with  ASD  communicating  with  an  accompanying  adult 
about  Robota,  and  children  with  ASD  were  interested  in 
sharing  the  experience  of  Kaspar  with  the  researcher  in  the 
room.7  Kozima  and  his  colleagues  also  reported  instances 
involving  Keepon  in  which  a  child  engaged  in  triadic  inter¬ 
actions  with  the  robot  and  the  caregiver.1 
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Figure  2.  The  robot  Troy,  (a)  The  robot 
had  a  seven-inch  computer  screen  for 
a  face  and  movable  arms;  (b)  a  clinician 
used  a  Wii  controller  to  direct  Troy  to 
move,  change  its  display,  and  speak  or 
sing;  and  (c)  Troy's  face  could  express  a 
range  of  basic  emotions. 
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if  and  how  robots  can  serve  an  educa¬ 
tional  or  therapeutic  role  as  toys  for  chil¬ 
dren  with  autism.9  She  observed  that 

•  children  wanted  to  interact  with 
the  robot  for  10  minutes  or  more, 

•  children  were  more  interested  in 
the  robot  when  its  behaviors  were 
interactive,  and 

•  most  children  showed  more  interest 
in  the  robot  than  in  a  similar-looking 
but  nonrobotic  toy. 

We  know  of  no  literature  where 
the  robot  was  used  in  a  low-dose 
role  as  part  of  a  larger  therapy  team, 
however. 

The  Robot's  Physical  Form 

Researchers  and  clinicians  at  the 
BYU  Comprehensive  Clinic  identified 
two  clear  criteria  that  the  robot  must 
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satisfy  to  fulfill  a  role  in  the  ASD  ther¬ 
apy  team.10  First,  it  must  have  a  form 
factor,  appearance,  and  mobility  that 
is  likely  both  to  engage  a  child  with 
ASD  and  to  trigger  dyadic  and  triadic 
social  interactions.  Second,  it  must 
be  capable  of  performing  several  pro¬ 
social  clinical  activities  such  as  tak¬ 
ing  turns,  imitating  movement,  and 
performing  songs  with  actions. 

With  respect  to  the  first  criterion, 
the  robot  (called  Troy)  was  designed 
to  be  the  same  size  as  an  average 
4-year-old  child.  Troy  is  25  inches 
tall  with  two  arms  12  inches  in  length 
(see  Figure  2a).  Each  of  Troy’s  arms 
has  4  degrees  of  freedom:  raising  and 
lowering,  adduction  and  abduction, 
medial  rotation  of  the  forearm,  and 
extension  and  flexion  of  the  elbows. 
The  robot  uses  its  arms  for  simple 
interaction  activities,  such  as  pushing 
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a  toy  car,  pushing  buttons,  pointing, 
waving  hello,  and  recreating  the  hand 
actions  associated  with  children’s 
songs11  (see  Figure  2b).  The  robot 
doesn’t  need  to  move  around  a  room, 
so  Troy  is  a  stationary  upper-body 
robot  that  can  sit  on  the  ground  or  a 
table  while  therapists  control  its  inter¬ 
actions.  We  mounted  Troy  on  a  base 
to  provide  stability,  and  connected 
it  to  a  laptop  computer  via  cords  ex¬ 
tending  from  the  posterior  torso.  The 
laptop  computer  sat  on  a  countertop 
out  of  the  children’s  immediate  reach. 

The  activities  in  a  typical  ther¬ 
apy  session  include  affect  expressed 
through  sound  and  facial  expressions. 
Consequently,  we  equipped  Troy  with 
a  seven-inch  computer  screen  encased 
in  plastic  to  serve  as  its  head.  The 
screen  presented  a  simple  face  that 
could  display  happy,  sad,  or  neutral 
emotions.  (See  Figure  2c.)  Two  remote- 
control  servo  motors  between  the 
screen  and  the  body  allowed  head 
movement  along  horizontal  and  ver¬ 
tical  planes.  A  speaker  inside  the 
torso  gave  Troy  speaking  and  sing¬ 
ing  capability.  A  student  from  BYU’s 
Music-Dance-Theater  program  re¬ 
corded  customized  greetings  for  each 
participant,  along  with  positive- 
affect  sounds  (such  as  “Woo  hoo!”) 
and  negative-affect  sounds  (such  as 
“Whoops!”).  We  added  simple  songs 
to  the  robot’s  repertoire  during  the 
case  study  described  later. 

We  designed  the  robot  behaviors 
to  promote  turn-taking  and  imita¬ 
tion  behaviors.  The  primary  clinician 
would  talk  with  the  child,  trigger 
autonomous  robot  behaviors  via  a 
Wiimote  (the  remote  control  for  a  Nin¬ 
tendo  Wii  gaming  system),  and  lead 
the  interactions.  The  secondary  clini¬ 
cian  would  provide  hand-over-hand 
support  to  gently  guide  the  child  in 
turn-taking.  A  typical  turn-taking 
activity  would  start  with  the  robot 
pushing  a  truck  to  the  child,  followed 
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by  a  request  from  the  primary  clini¬ 
cian  that  the  child  push  the  truck 
back  to  the  robot.  The  secondary  cli¬ 
nician  would  help  the  child  as  needed. 
The  primary  clinician  would  then 
“ask”  the  robot  to  push  the  truck  to 
the  clinician,  who  would  push  the 
truck  back  to  the  robot.  The  child- 
robot  turn-taking  would  repeat,  and 
then  the  child  would  be  asked  to  push 
the  truck  to  the  therapist,  followed 
by  the  therapist  pushing  the  truck 
back  to  the  child. 

This  turn-taking  example  is  con¬ 
sistent  with  the  goal  of  producing 
generalizable  child-human  social  in¬ 
teractions.  The  therapy  begins  with 
therapist-supported  dyadic  interac¬ 
tions  between  the  child  and  the  ro¬ 
bot;  proceeds  to  robot-mediated  tri¬ 
adic  interactions  between  the  child, 
robot,  and  therapist;  and  then  en¬ 
gages  the  child  in  child-therapist  in¬ 
teractions.  Perhaps  most  importantly, 
the  robot  is  only  fulfilling  its  role  in 
20  percent  of  the  interaction  time. 
The  remaining  80  percent  of  therapy 
time  is  dedicated  to  other  social  and 
developmental  needs  of  the  child. 

User  Interface 

We  designed  the  user  interface  on  the 
basis  of  the  theory  of  shared  inten¬ 
tions,  which  is  a  defining  character¬ 
istic  of  effective  teaming.12  The  team- 
based  therapy  process  illustrated  in 
Figure  1  produces  several  explicit 
representations  of  shared  intention. 
These  include  written  plans  for  each 
session,  documentation  of  assessment 
and  diagnostic  activities,  explicit 
therapy  goals,  and  summaries  of  the 
sessions.  This  body  of  documenta¬ 
tion  serves  the  human  members  of  the 
team  well,  but  not  the  robot.  Instead, 
we  programmed  shared  intention  into 
the  robot  between  therapy  sessions 
and  developed  technology  to  let  the 
therapist  tell  the  robot  what  to  do  at 
various  times  in  the  therapy  session. 


www.computer.org/intelligent 


We  contend  that  for  robot-assisted 
therapy  to  flourish,  therapists  must 
program  robots.13’14  Programmer  ex¬ 
pense  is  one  reason  for  this,  but  more 
importantly,  programmers  aren’t  part 
of  the  therapy  team  and  don’t  help 
construct  and  refine  shared  intent; 
they  probably  won’t  completely  un¬ 
derstand  what  robot  behaviors  the 
therapist  really  needs.  Since  program¬ 
ming  is  generally  outside  the  purview 
of  therapists,  we  developed  technol¬ 
ogy  that  lets  them  program  robot  be¬ 
havior  according  to  the  principle  of 
encoding  shared  intent. 

Figure  1  illustrates  that  most  of  the 
work  on  constructing  and  refining 
shared  intention  actually  takes  place 
outside  the  therapy  sessions.  Between 
therapy  sessions,  the  therapy  team 
evaluates  progress  and  decides  what 
the  child  needs  to  progress.  Thus,  we 
target  “between  session”  program¬ 
ming,  wherein  the  therapist  programs 
the  robot  to  perform  specific  behav¬ 
iors  targeted  to  specific  therapeutic 
objectives.  The  portion  of  the  shared 
intent  represented  to  the  robot  is  a 
choreographed  sequence  of  behaviors 
that  describe  a  contingency  plan  for 
what  the  robot  should  do  given  cer¬ 
tain  inputs  from  the  therapist.15 

We  have  developed  a  prototype 
drag-and-drop  visual  programming 
user  interface  that  lets  a  therapist 
arrange  existing  robot  behaviors 
in  sequences  and  map  those  se¬ 
quences  to  an  input  device.16  Figure  3 
shows  the  user  interface  as  it  ap¬ 
peared  during  use  in  the  clinic.17  The 
user  places  blocks  that  represent  ro¬ 
bot  actions  or  user  input,  then  con¬ 
nects  the  blocks  with  arrows  to  in¬ 
dicate  program  flow.  In  this  way, 
the  user  chooses  a  few  robot  actions 
and  then  assigns  buttons  on  a  remote 
control  to  initiate  those  actions.  Im¬ 
portantly,  the  user  interface  explic¬ 
itly  represents  the  state  machine  that 
encodes  the  contingency  plan  for 
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Figure  3.  The  prototype  programming  interface.  The  therapist 
could  arrange  robot  behaviors  in  sequences  and  map  those 
sequences  to  an  input  device. 


switching  between  robot 
behaviors. 

Two  therapists  success¬ 
fully  used  a  prototype 
version  of  this  interface 
to  create  choreographies 
for  the  robot,  and  then 
they  used  these  choreog¬ 
raphies  in  therapy  with 
children  with  ASD.  Three 
other  therapists  who 
hadn’t  used  the  robot  or 
user  interface  were  also 
able  to  create  choreog¬ 
raphies  after  10  minutes 
of  training.  These  results 
aren’t  statistically  signifi¬ 
cant,  but  they  do  demonstrate  that  it 
is  possible  for  a  therapist  to  encode 
the  robot’s  role  explicitly  in  a  pro¬ 
gram  that  the  robot  can  execute. 

During  a  therapy  session,  the  clini¬ 
cian  must  be  capable  of  following  a 
series  of  paths  through  the  state  ma¬ 
chine  depending  on  how  the  child  is 
acting  or  reacting.  We  required  the 
clinician  to  trigger  the  robot’s  behav¬ 
ior,  because  understanding  the  state 
and  intent  of  the  child  within  the 
scope  of  the  therapy  is  currently  be¬ 
yond  the  capabilities  of  the  robot.  In¬ 
deed,  understanding  the  state  and  in¬ 
tent  of  a  low-functioning  child  with 
ASD  is  often  beyond  the  capabilities 
of  a  single  human,  which  is  why  we 
employ  a  therapy  team. 

Therapy  is  a  high-workload  envi¬ 
ronment  for  the  therapist,  who  needs 
to  interpret  the  child’s  behaviors  in 
some  social  or  regulatory  context,  fa¬ 
cilitate  child-directed  activities,  miti¬ 
gate  negative  child  behaviors,  and  se¬ 
lect  and  engage  in  activities  that  can 
promote  both  the  planned  and  unan¬ 
ticipated  therapeutic  objectives.  Be¬ 
cause  of  this,  the  therapist  doesn’t 
have  much  time  to  interact  with  the 
robot.  Moreover,  as  a  practical  con¬ 
straint,  children  with  ASD  might  find 
electronic  devices  engaging,  so  any 


sort  of  overt  remote  control  for  the 
robot  could  distract  them  from  the 
therapy  (although  in  at  least  one  case, 
a  remote  control  facilitated  child- 
adult  interaction18). 

For  within-session  control  during 
the  case  study,  we  used  a  Nintendo 
Wii  remote  for  our  input  device.  This 
remote  is  small,  wireless,  easy  to  use 
without  looking,  and  readily  avail¬ 
able.  We  currently  use  only  the  but¬ 
tons  on  the  remote,  and  not  the  other 
sensors  such  as  the  accelerometer  or 
infrared  camera. 

Intervention  Case  Study 

Unlike  much  other  previous  work  re¬ 
garding  using  a  robot  to  help  children 
with  ASD,  our  study  focuses  less  on 
the  child  and  more  on  the  team  of 
child,  clinicians,  caregivers,  and  ro¬ 
bot.  Simply  put,  our  goal  is  to  help 
clinicians  by  developing  robot  and 
user  interface  technologies  that  let 
the  robot  fulfill  a  low-dose  but  criti¬ 
cal  role  in  team-directed  therapy. 
We  undertook  a  trial  to  evaluate  this 
team-centered  approach. 

Participants 

Two  children,  three-year-old  Alex 
and  eight-year-old  Chris,  partici¬ 
pated  in  the  intervention.  (The  boys’ 


names  have  been  changed 
for  the  sake  of  privacy.) 
Both  boys  were  identi¬ 
fied  with  ASD,  and  both 
were  enrolled  in  special 
services  through  their 
school  districts.  Alex 
and  Chris  had  been  fol¬ 
lowed  in  the  BYU  Speech- 
Language  Pathology  Clinic 
for  intervention  target¬ 
ing  joint  attention  and 
social-engagement  behav¬ 
iors.  Although  Chris  was 
older  and  higher  func¬ 
tioning  than  Alex,  both 
boys  demonstrated  mod¬ 
erate  to  severe  levels  of  impairment 
in  social  communication,  as  well  as 
restricted  interests  and  repetitive  be¬ 
haviors  (such  as  spinning  a  puzzle 
piece  or  fixating  on  the  same  toy). 
Neither  boy  had  made  marked  prog¬ 
ress  on  intervention  goals  in  the  pre¬ 
vious  six  months.  We  obtained  ap¬ 
proval  from  the  Institutional  Review 
Board  and  informed  consent  from  the 
parents  before  beginning  the  study. 

Procedures 

Each  participant  came  for  16  treat¬ 
ment  sessions  over  a  three-month 
period.  Each  session  consisted  of 
40  minutes  of  treatment  (without  the 
robot)  as  part  of  an  ongoing  interven¬ 
tion  program,  followed  by  about  10 
additional  minutes  devoted  to  inter¬ 
action  with  the  robot.  This  organi¬ 
zation  of  each  treatment  is  consistent 
with  the  team-based  approach  to  the 
therapy,  dedicating  the  bulk  of  the  re¬ 
sources  to  human-child  interactions 
but  using  the  robot  to  engage  the 
child  and  promote  dyadic  and  triadic 
interactions. 

The  therapeutic  interactions  in¬ 
volved  the  child,  a  primary  clinician 
(who  was  a  graduate  student),  a  sec¬ 
ondary  clinician  (also  a  graduate 
student)  to  provide  hand-over-hand 
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Table  1.  Social  engagement  behaviors  before  and  after  treatment. 


No.  of  engagements  initiated 

No.  of  engagements  responded  to 

Child 

Pretreatment 

Post-treatment 

Pretreatment 

Post-treatment 

Alex 

11 

120 

108 

488 

Chris 

48 

65 

107 

146 

prompts,  and  the  child’s  parent  (when 
available).  Using  the  programmed  ro¬ 
bot  contingency  plan,  the  primary 
clinician  instigated  a  series  of  inter¬ 
actions  in  which  that  clinician,  the 
child,  and  the  robot  participated  in 
reciprocal  activities  (such  as  waving, 
pushing  toys  to  each  other,  and  sing¬ 
ing  songs  with  actions).  The  expres¬ 
sion  of  positive  or  negative  affect  was 
intrinsic  to  each  interaction. 

Assessments 

We  conducted  pre-  and  post-treatment 
assessments  of  social  engagement  (not 
involving  the  robot)  in  four  contexts: 
child-parent  interaction,  clinician-child 
interaction,  triadic  interaction  (with 
both  clinicians),  and  child  interaction 
with  an  unfamiliar  adult. 

For  the  child-parent  interaction, 
we  provided  the  parent  with  several 
toys,  including  trucks,  a  bus,  helicop¬ 
ters,  dolls  and  doll  accessories,  and 
blocks.  We  asked  the  parent  to  inter¬ 
act  with  the  child  as  he  or  she  nor¬ 
mally  would  for  20  minutes.  For  the 
clinician-child  assessment,  the  cli¬ 
nician  introduced  various  toys,  in¬ 
cluding  dolls,  doll  accessories,  a  toy 
truck,  blocks,  and  a  toy  garage.  The 
clinician  handed  the  child  each  toy. 
If  the  child  played  with  the  toy  ap¬ 
propriately,  the  clinician  commented 
on  the  child’s  play  and  attempted  to 
elicit  joint  attention  with  the  child. 
If  the  child  did  not  play  with  the  toy 
appropriately,  the  clinician  modeled 
appropriate  play,  gave  the  toy  to  the 
child,  and  attempted  to  establish  joint 
attention. 

For  the  triadic  interaction,  the 
child’s  primary  and  secondary  clini¬ 
cians  interacted  with  the  child.  The 
clinicians  initiated  20-minute  play  se¬ 
quences  in  which  they  encouraged  the 
child  to  take  a  turn  pushing  a  toy  car, 
hitting  a  tambourine,  operating  me¬ 
chanical  toys,  or  pushing  a  ball.  For 
the  unfamiliar  adult  interaction,  a 


clinician  not  familiar  to  the  child 
introduced  several  toys,  including 
wind-up  toys,  a  ball,  a  hat,  a  comb, 
and  a  book,  and  attempted  to  elicit 
joint  attention  similar  to  the  clinician- 
child  interaction.  The  unfamiliar 
adult  also  sang  two  songs  with  ac¬ 
tions.  This  assessment  lasted  approxi¬ 
mately  10  minutes. 

We  also  conducted  pre-  and  post¬ 
treatment  assessments  using  the  same 
materials,  individuals,  and  meth¬ 
ods,  with  the  exception  of  the  inter¬ 
action  with  an  unfamiliar  adult.  In 
this  case,  a  different  adult  elicited  the 
post-treatment  assessment  to  main¬ 
tain  the  unfamiliar  status.  We  filmed 
all  interactions  with  both  a  station¬ 
ary  and  a  handheld  video  camera.  Al¬ 
together,  the  assessments,  designed  to 
evaluate  whether  the  robot  promoted 
child-human  interactions,  used  vari¬ 
ous  members  of  the  therapy  team  plus 
two  unfamiliar  adults. 

Analysis 

We  analyzed  the  pre-  and  post-treat¬ 
ment  assessments  using  a  coding  sys¬ 
tem  based  on  the  work  of  Connie 
Kasari  and  her  colleagues.19  Behav¬ 
iors  analyzed  included  initiating  so¬ 
cial  engagement  and  responding  to 
joint  social  engagement  using  lan¬ 
guage  or  gesture,  eye  contact,  display 
of  affect,  and  imitation.  We  analyzed 
videotaped  footage  in  five-second  in¬ 
tervals  and  coded  for  the  presence 
of  target  behaviors,  and  we  estab¬ 
lished  interjudge  reliability  in  coding 
at  80  percent  (that  is,  that  the  judges 
agreed  on  the  appropriate  codes  at 
least  80  percent  of  the  time)  before 
pretreatment  assessments.  Two  in¬ 
vestigators  then  analyzed  the  pre- 
and  post-treatment  data.  Following 
the  analysis,  the  two  investigators 


independently  coded  20  percent  of 
the  footage,  and  we  documented  89 
to  91  percent  agreement  across  the 
behaviors  coded.  In  addition  to  this 
analysis  of  social  engagement,  we  re¬ 
corded  clinical  observations  of  social 
communication. 

Results 

Table  1  shows  the  production  of 
social-engagement  behaviors  before 
and  after  treatment.  Alex  showed 
dramatic  increases  in  socially  en¬ 
gaged  behaviors  from  before  to  af¬ 
ter.  Chris’s  gains  were  more  modest. 
Clinical  observations  indicated  that 
both  children  were  highly  motivated 
to  interact  with  the  robot,  and  both 
were  more  interactive  with  clinicians 
without  the  robot  following  treat¬ 
ment.  We  observed  several  significant 
behaviors  (in  the  absence  of  the  ro¬ 
bot)  after  treatment  that  had  not  been 
observed  before,  including  greeting 
clinicians  by  waving  (and  in  Chris’s 
case,  saying  their  names),  symbolic 
pretend  play  with  toys,  sharing  toys, 
and  decreased  restricted  interests  and 
repetitive  behaviors. 

Our  case  study  and  technol¬ 
ogy  development  have  un¬ 
covered  many  important  challenges 
and  research  opportunities.  One  of 
the  most  critical  is  to  identify  clini¬ 
cal  approaches  that  allow  us  to  reach 
statistically  sound  conclusions  for 
a  problem  with  as  many  confound¬ 
ing  factors  as  autism  therapy.  Such 
factors  include  frequently  sharp  dif¬ 
ferences  in  behaviors  among  chil¬ 
dren  with  autism;  the  complexity  of 
coordinating  therapy  across  a  large 
team  of  therapists,  caregivers,  and 
educators;  and  the  vast  range  of 
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